Pagerduty + Nagios Integration - Watchdog / Heartbeat functionality

Hi :wave:

If someone blocks access to Pagerduty what is the best practice to trigger an alert that Nagios it’s not capable of sending events to the integration?

So far I’ve tried this approach:

  • Sending periodic events to Pagerduty and trigger an alert if it hasn’t received it.

I tried doing this by Event Orchestration by routing all events to the service that has the integration with Nagios. The action rule that I used is something like this:

trigger_count over 10 minutes < 2

The Incident Actions were set to Create alert but pause notifications and in the Alert Actions I set a custom/trigger to always trigger an alert.

Reading the docs it says:

If you don’t have EI, then trying to create a condition with these functions will return an error.

This is not triggering as I expected. Am I missing something? I’m on a trial account and I’m not receiving an error, so I thought this would work.

Another thing that I saw is this post talking about the Dead Man’s Snitch. I guess that would cover the use case of checking if the machine that has nagios installed is able to check if has internet connectivity and trigger PagerDuty if the heartbeat doesn’t happen.

Any suggestions or ideas?

Thanks